• Skip to primary navigation
  • Skip to main content

DebKR

To the Stars

  • About
  • Blog
  • Contact

Data Analytics

Bookmarks: Databases in Java

Bookmarks: Databases in Java

28/08/2017 By debkr

Here are some links to useful documentation on Databases in Java (based on NetBeans IDE with GlassFish Server).

  • NetBeans.org documentation, search results: here
  • Working with Java DB databases, configuring databases: here (in particular, see section on “Registering the Database in NetBeans IDE” in the Services tab)
  • Oracle.com documentation on Developing Applications with NetBeans IDE – section 24: Working and Connecting with Databases

 

Filed Under: Blog, Data Analytics, Data Science, Programming, Software Development

Data Literacy Skills

Data Literacy Skills

01/04/2017 By debkr

I was excited to find the following Data Literacy Skills self-assessment framework, for use as part of a continuing professional development programme, available via the Open University’s library services (OU login required). This URL links to the Masters level skillset; other lower levels are also available on the same page. Examples and links to further resources are also given.

While this framework is geared towards data literacy for research students, it’s still highly relevant and can be mapped over to finance- or IT-based roles. It’s a shame it appeared too late for inclusion in my last assignment (on Data Literacy for Accounting Professionals) but it will prove useful for projects which will come out of that piece of assessed work.

The data literacy link was buried within the continuing personal and professional development section of the post-grad preparatory material (MD500, OU login required). This free module has lots of really important study skills, research skills, advice on becoming an active learner and longer term careers resources too. (Yet more things for me to go through when I find a spare block of time!)

Filed Under: Blog, Data Analytics, Finance & Economics, Web Data

Twitter Lists & APIs

Twitter Lists & APIs

18/01/2017 By debkr

I’m trying to find time to set up automated tasks on twitter (not too successfully as I’m trying to do too many things at once). Here’s my original post on twitter mining: http://deborahroberts.info/2016/05/coding-101-part-12-extracting-data-with-json/

And here’s some useful links worth bookmarking:

Using Twitter lists: https://support.twitter.com/articles/76460#

Getting Tweets (REST API): https://dev.twitter.com/rest/reference/get/search/tweets

API Console: https://dev.twitter.com/rest/tools/console

 

 

Filed Under: Blog, Data Analytics, Personalised Training Plan, Programming

D3.js and Data Visualisation

D3.js and Data Visualisation

11/07/2016 By debkr

data-visualisationData analysis process:
When we encountered the data analysis process earlier in the year, we saw the basic process consists of: gather; clean; analyse (including, checking for accuracy); and finally, visualise/present. We’ve been doing lots of Python programming coupled with creating SQL databases to extract data from some source (web pages, files, XML or JSON files) and sort or store it in a database.

The process we’ve been using during the capstone course – and in line with the original Page/Brin search engine process – is to first collect the raw data and store it – unprocessed – into a holding database. From here we’ve gone on to clean up the data and save it in a more structured way in a new, relational database. This results in a smaller database which is quicker to search and retrieve data from. As I found when writing my own search engine application, these first two databases take a long time to retrieve the data, especially when the search engine’s reach is set widely. [Read more…] about D3.js and Data Visualisation

Filed Under: Blog, Data Analytics, Data Analytics Projects, Personalised Training Plan, Programming, Programming Projects, Web Data Tagged With: coding101

Coding 101 (part 15) Databases and beyond

Coding 101 (part 15) Databases and beyond

09/06/2016 By debkr

SQL-databases-with-many-to-many-relationshipsGetting even more complex – many-to-many relationships:
We’ve learnt that there are several different kinds of relationships in a database (dependent on what data we’re trying to model). When we map out our data model, we should try to capture each the relationships between each of the tables in the model. In database terminology, the nature of each table-to-table relationship is referred to as the cardinality of the relationship.

Previously we looked at databases with one-to-many (and their converse, many-to-one) relationships using a Primary Key as the unique, auto-incrementing ID number in the One-Table (e.g. Recipe Type) and linking this through to the Foreign Key ID number in the Many-Table (e.g. Recipes). [Read more…] about Coding 101 (part 15) Databases and beyond

Filed Under: Blog, Data Analytics, Digital Business Systems, Personalised Training Plan, Programming, Uncategorized Tagged With: coding101

Coding 101 (part 14) Relational databases

Coding 101 (part 14) Relational databases

04/06/2016 By debkr

relational-databasesStarting out with databases:
This section moves on to working with SQL databases (focussing on SQLite3) as well as delving into some data gathering, analysis and visualisation in Python. Why store the data? Well we probably want to build up data over time – maybe it’s coming from reviews of customer activity, or PR hits, or perhaps we’re scraping data from the web and the web crawler is continually replenishing its list of target URLs (hence going crawling some more). Or maybe we’re getting our data from an API which restricts our access on a rate-limiting basis so we can only run x queries today, then have to wait a while before we can make more requests. [Read more…] about Coding 101 (part 14) Relational databases

Filed Under: Blog, Data Analytics, Digital Business Systems, Personalised Training Plan, Programming Tagged With: coding101

Marketing Analytics: Applications & Innovations

Marketing Analytics: Applications & Innovations

15/04/2016 By debkr

rubiks-cubeCustomer analytics – a recap:
As we’ve seen in previous posts, there are five important elements to the process of marketing/customer analytics:

1. Start with the data: we need to ensure we have the right data, but we should make sure this is individual-level data – data held for each customer. Without it we can’t do effective customer analytics. So a big question for the company is: how to build the right infrastructure to collect that level of data, with that level of granularity?

2. Exploring the data: we shouldn’t start with big complex models, but look always to start simply with a basic exploration of the data. Even when we go on to use complex mathematical or statistical models, we still need to be able to understand the underlying data, to be able to sense check our explorations and predictions against that data which allows us confidence to assert, yes the underlying data does suggest/show that our modelled effects are real or reasonable. [Read more…] about Marketing Analytics: Applications & Innovations

Filed Under: Blog, Data Analytics, Digital Business Systems, Personalised Training Plan Tagged With: analytics, business, channel, contribution, customer, data, digital, marketing, marketing analytics, offers, online, product, profit, profits, purchase order, purchasing, sales, web advertising

Next Page »

Copyright © 2016–2025 · Powered by WordPress On Genesis Framework · Log in

  • Writing
  • Developing
  • Consulting